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I. Introduttion 

The National Institute of Education "has a*clear responsibility, to 
provide leadership in the conduct and support of scientific inquiry into the 
•educational process." (Sec. 405 (a) (1), Pub. Law 92--318) ' Furthermore, 
"the Director is authorized, through the Institute, to conduct educational 
-fesearch; collect and disseminate the findings of Educational research; train - 
individuals in educational Research; assist and foster such researtfh, collection 
dissemination, or training through grants, or technical assistance to or • 
iointly financed cooperative arrangements with, public or private organizations, 
institutions, agencies, or individuals; proinote the. coordination of sirch 
research and research Support within the Federal Government; and may C9nstruct 
or provide (by grant or otherwise) - for such facilities as he determines m^y 
be required to accomplish such purposes. As used in this subsection, t*ie . 
terra 'educational research' includes research (basic and applied), planning, 
surveys, evaluations, investigations, ^experiments, developments, and demon- 
strations*in the field' ot education (including career education)." (Sec, 405 
(e) (1), Hub. Law 92-318). ^ , 

In pursuit of this responsibility the Director requested that a ^port 
be prepared for his use on the nee^s for research 'in ^ost secondary education, 
with special emphasis on those activities most appropriate for the National 
Institute of Education. . ^* . 



March 10 to ApHU.6, 1976^ the authors ihterytewe4|umeroui . s ;;;,:' ;; 
fepresentatives\of the' post/ejfe/Ujary education community. Among ,thf>$e/. • . •, ; , ' 
• interviewed were staff of pWTate foun'dafcionf , educational atjd scholarly" ' 
..-ar^^^oeidtions , student " representatives, the Federal Govef nmerit , academic 
-instiXutionVihe National, Ins.titttte'df Education, and other interested'^- •• •• /^ 
parties^ Per^nen't lltAf'ature was reviewed and numerous suggestipngr' wQ're 
received by mail "in 'res/onse to a request from the Director -to selected; . >' ' /• 

... individuals. / ' % , i * . , 

The authors express their appreciation* to all those who have assisted 
in'thls effort -and regret that the time available did 'not allow further ^ 
consultation with all those who offered assistance. ' 
- * -This report does not attempt to detail specific projects -for research 

'but rather tries \to indicate major concerns, trends and areas for further 
' "inv^atigation. It should" not- be consid«r^ii, as all inclusive, as the gospel, 
or. the "only way'-' that things, should be done. Obviously the ideas are not 
'•orn',irial with3||, but' since they are distilled from mdhy sources, we, have . 
not attempted.. to give specific credit to the source of each. We hope that 
- al] of our advisors will recognize" some elements of tkeir contributions. 

The hope is that this report will provide a framework for the creation 
of Specific research objectives, projects and programs. We trust tlfet the 
reportj will start, a continuing process of defining directions and priorities 
for NIE efforts in postsecondary eJducation. i 
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*' S -V' -i-V;' -^t^"^^ ^ "^^"^ "^-v/A / 1..-. 

.* •'^ . . • --^ '"-.-^^ 

' S^tiaent* phy ^C-fe!eristici^ ^ _' . , v • ! 

If we gVaftb that- t-he'.i3UTp65e-:'ojf ^osts^on.^^rjfeducatlon ie td. assist . 

students ^tb' Igarri , r«eartM on ;:har'act'efisttcs, of; the'iearp&rs-,- tlftlT-- Variety; • -i^:-. 

•^he^: expeeta.tiong/.a,^iJ:itieV,.and -' • ' .- , 

• The ' changing character qf ' the st udent popuUt ion :has -b^fen well >- " - ■* 

dQCumeflLcd.. ^Wfiat Is still not well urid'ers"t6bd-..is how educational opportunities , 

din* in^st^' effectively be made available and aiapted'.to fhe ardng^'o.f student 7 . 

^ • • ^ , • '-^ ' ' . ' ,:^"^.\ 

dhis!(cjcizt^rist\cs . •«.. ,' ., ' . - • • • ' ; ' 

' ' ife.now know that, learning ■aWlity in..!^^^^ 
rather than d^creas^svj We aUo know • that le3i;ning deficiencies >n' chiU^^^ 
arl critical but not i7re'mediable.. thus pTpductive re&ffarch isJ-pd^ssitile upoln ,• . 
svch topics as differences^ 'in learning, in educational >Uu?t ions foi younger 
and older learners, the educational needs and strengths of minority group 
members,, Che changing motives .d> women students ^in''^r %<?tlet-y^ the spectat " 
assets and problen* of bilingual learners/ and., the clanging heeds of learneTS.-.. ■ 

at .different life- stages. As we think of lif e-long-learniftg-, we eaii r^-evaluate 
the '.role of the f our-y|aV icollege in meeting the lifelong needs Qf students. " 
-Perhaps certain needs can be met pore efficiently at later age periods through 
different modes. ' ' ' ^ • • • 

■■' Access:- Wh^t Factors .j)etermine Participation In Postsecondary Education? 

Individuals of all ages are presented with a wide variety of post- 
secondary edupa'tlonal .-opportunities. Research is needed on the percepti^s • 
.potential students have of postsecondary education. Are they awatft of the 

' • ■ 8 •' • . • 

o ■ • 
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' range ' of possibiUties'2 How do they assess tHe demands of postsecondary 

.caUon ln.relation to their perceptions of pheir own abilities and work 
"^^abits? ^ow do their educational aspirat^ns fit with the goals in in«ti- 
^' tutions of postsecondary education C^^of their own perceptions of the , 
likely outcomes of postsecondary education.)? ^ In -king decisions about " . 
•Whether or not. to continue fonnal education, ot what 'fortn of education to 
■;;ut.ui,^hat vilues are individuals trying to achieve? How.do their experi- 
encsfe help, them revise their decisibns? 
'5; '.-HOW do financial factors influence^student decisions? How.-do 

/<tifferent .patterns of • financing and cl^arging for postsecondary education 
' ■ af fee.; entry and continued participation in postsecondary edbcation? Are . 
. . the 'effects different .for different -groups? How successful have open 
admissions been In, reducing inequity? . With the increasing tendency to ; 
• limit enrollments. r.sea/ch on the effect of open admissions is greatly needed. 

40 student perceptions of^ th>ir own futures as adult*' f*t With . 
Export, judgments of labor market needs. , and other characteristics of the 
, society 5-40-20 yea.s in the, future? The Education and Work Group is'^r^ady 
, . studying how 18 year olds and older individuals differ in career exploiation." 

* ..What kinds of information do studfents use? • Can the information be 
, -improved? .The National' Student Educational Fund has i^entifi^d . gap. Researt 
can- extend their, findings. What is th. tole of Counselors? Can we Improve 
the training and effectiveness Of counselors? The Experience-Based Career^ 
Education program can provide a^start for research in postsecondary career ^ 

coinnseling and education. . \ 

one of the more important <?urrent research efforts in this Vea is the 
ACE sutveV of freshmen." While heard varioiis cViticisms of th. sample and 
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' scope of the survey, there was, general a&reement that data. of this sort are 
valuable especially when coupled with' periodic longitudinal surveys. 

III, .The Process of Education— Tfeachin>g and Learning.* 

•Ultimatery, postsec6nd.ary education ci'eals with student .leart^g. 
Therefore, research on learning and teaching^ ml^st be"^ one of the/fundamental, 
' parts of any. program in postsecorvdary education. Thfe effect^ Df changes in ' 
financing, changes in admission practices, changes- in university management — 
all of 0h€se must be evaluated in therms of how they .affect th^ learning, of 
studwts* ' ' , ' 

Learning \ ' V - , , ' 

Research in learning in, edifcational settings' is timely in that the 
basic -science necessary* for ^progress hasi rec'eiitly iOiade great advances. - ^ 

Learning theory has 'Vithin the iast teji or twenty years shifted from an 
, emphasis uporyc^nifnal learning to an empha&is upon hpman- learning, from 
eTnphasi2>rfg nonsense syllables and the learning of simple motor skills to i ^ 
an eidphasis upon meaningful ver,bal learning/' from the study ^/^imple habits 
'"fo'the study of complex cognitive structures, and from study in simpj-jej ^ 
one-variable laboratory situati^^^-^o^ofr-rompiqKt multivariate analyses* 
Some 'of .the. basic .studie^^^lnleartiing theory now involye studies of learning 
of mathematics, cJf second Ickn&ua&e's < or other topics immeiiately 40nc?rnea 
'with education/ On the- whole, however, /we lack reseajr^h knowledge ^out trie 

lAture of learjitrig in educational situations ^nd about how teaehihg can 

<'''^ , , - * ' \ 

^facilit^te more effective learnins^ 1 ' 

. At this point it appears' that ift.wdUld be'iJroduc^ive to orfFr/ oufe^ ^ 
„ research on tht st^diesi'of the^learning strategies ^istucjjpnts actually us4 
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^the ways in which they retrieve and apply their learning outside course 
• examination situatlftns. and. the degree to which learning strategies can be 
modified sb that .students can develop a mote flexible repetoirfe of strategies.^ 
If an effective system of classifying -learning strategies can be developed. 
It wouTd be worthwhile to know how strategies differ fpr different groups 
such as older learners versus younger learners, second language learning 
versus first language le^irners, mindrity group or working class learners 
vet^us uppdr middle class majority group learners, etc. 

" Research has deinonsti*ated that education can Se more effective if one 
adapts it to the current strategies of a group of learners. We need to know 
,how education can help these learners develpp additional strategies and use 
. tViem adept iv6ly. To do this we need a good deal of basic research on 

cognition as well as research on methods of identifying learning strategies 
and of teaching new ones. * ' ^ ^ , , • , 

Mcjttivation anA Values ' '■.) * 

A closely related problem is that of motivation for leapning.; < There , 
is'now much greater recognition of the importance of curiosity , and iAtrinsic' • 
motivation for learning as importartt educational' goals . In fact, many 
educators would take the goal of deve^ing potivation for life-long learning^ 

beTnr"on*"oTThe^st important objectives of postsecondary education. 
„The basic' resea^hers in psychology have recently become more and niore 
involved in the relationship bej:ween *dif f efent patterns of rewarding learning 
,.'and their impact upon long term motivation\ Some of the dominant, mot^s in 
our society, #uch as need>for achievement, are changing. . For' ^Mtf^le, - 
#he impact of the changii^g roles of woqen upon motivation iias^uc^tionf 1 , 
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significance. Basic research and research in" the traditional black colleges 
is linking motivatiot/and bahaviJr fo perceptions of onfr's ovm algj^ty t^p - 
influence one'^ fate.\ Support or research* in classroom and other educational 
situations on factors 'ih<luenciMg motivation for learning and the nurturing . 
,f motivation for li/e-long^earning'-is important for education. 

'A closej^y^ related area of much current! interest is that of the , . 

development of values. We know that values are influenced to some degree ^ 
by^gollege an^ o'thtir educational ^experiences, perhaps more by peer groups ' ^ 
than by. professors, ^-4i^velopraeiital theories of . values emphasize the importance , 
>f models in determining valUes, and there is some experimental and anecdotal 
ividence indicating; that faculty members are often significant figures in 
jtudent's lives. We need 'further .research determining what factors infiuettce 
the impact of'education upon student values. -f 

One of the relics of the period when ed/catdrs proclaira^jl the value 
neutrality of education is ignorance about C^ierole of the scholarly disciplines 
in the de'velopment and integration of va^ties. It may well be that academic ' 
jxperiences provide prerequisites 'f ot/understanding the application of values 
to new situations. For example, literature, biography, and the behavioral 
sciences may actually have an important impact, not so much on the acceptance 
of the valuc^^of altruism', but. upon the degree to which students practice— 
altruis.tic behavior becJfuse they gain the ability to see human beings in other 
nationalities or racial groups as being like themselves in terms of needs, 
aspirations, and feelings. Concern with va^lues need opt imply .indoctrination. 
Rather, research can help us understand how education can be more effective 
in helping student.^ live the.values'.ifehey profess* ^ * 
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Teaching and Delivery^ Systems , ^ ' - 

At the same time that work goes forward on the *ftature learning and 
. aotivation, it is important that research approach the problem from the 
standpdint of the teaching side of teaching and learning. Research has 

« 

already demonstrated tlTe greater effectiveness of pertain gethods as compared 
with others (e,g, discussion is superior to, lecture for goals of application 
' and thinking). It is unlikely, however, that any one teaching method 
or any technology is going to have dramat"li^ if fects upon leamang^or ali' 
objectives and all students. Rather, we can^ more effective wlthx 
* Varticular kinds of students and with particular objectives If bur teaching 
** methods are chosen with respect to these considerations^' 

Sociological studies of classroom interaction are giving new undcn- 
starxdin^^of the ways in which studejit ^nd teacher roles interact to affect 
lea nving.._Soci^'^c^^re search in medical schools demonstrates that 
implicit values and norms are communicated by the curriculum, the faculty 
^^d peer 

Statistical techniques now .enable us to tease .Xfut SP^^e of the liulti- 
varXate factors that affect teaching and with new deTeloproents in fl|pi$^er, 
video and obh^x.^4^nological aids addAtc^the teachers tool kit, it is 
possible to devise edjucational -program^^at can reach students who have 
previously been poorly>served by the standard lecture format. 

Currently, a larfee number of programs, special colleges, and individual 
courses 'a^e trying new* iVis true tional modes or new curricida. / In some instances, 
these. programs tnvolv^ various interdisciplinary combinatidns; |fn other 
cases they involve a focus around prdblems* rather than, the traditional 
■ disciplines^; 'and. in other jcases they involve var Ut ions 'In tefchiaf methods. 
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■ethods of evaluation, or the use of techooiogy or other types of atypical 

educational experifences. We need -to develop a taxonomy that will enable us 

to relate outcomes^ from these different methods to different, goals and to 

determine what kinds of students are likely to benefit most from them. The 

contract system, field experience, problem oriented programs, and other ^ 

f 

innovations have had very little systematic evaluations. 

Education is frequently characterised as being inefficieTit and 
resistant to tecjinological improvements. Ke suspect that the reason 
technological innovations seldom demonstrate improved effectiveness is that 
i:he educational delivery system has been highly effective since t^Je invention 
of the printing press, and even more so -sihce the invention of paperbaqk books 
, and Xerox machines.^ Thus, the control system against which new delivfery - v 
systems should be Rested is corresppnd^de study, ' • 

The current NIE evaluation of open education seemf to as a model/of \ 
what ^^IE can a^d shoui<i:do. As we understand it the following features are- . ; 

signif iQant : > * ♦ ^ ' ' " 

\ \ '* 

• > 1, Rather than developfpg an evaluation 6f a single progra^Q 
such as UMA./NIE developed a taj^onomy which placed UMA and 
other open education prog^^ms on cotmon dimensions so that the 
evaluation \:ould be generalized beyoTid a specific prb^am, 
2/ The evaluAt^^n^inyolVes opt only Np: funded programs tut 
aisb Other program^. wit;h coiaiabn features relevant to the 
\\ dimensions- being^ studied.. , ^ . • • 

Potential users of ^t1>fe\e^Iuat:ive information wer^ identified. 



* in aUvance and involved in desigp of -the evaluation* . 



The Taculty >• . » 

One cannot think, about te^^hing and learning without thinking about 
those who are responsible for teacl^ing and planning the learning situation . ~ 
,in institiltions of postsecomlary education .-- .the faculty. This la an area 
which iacki a tradition of continued syst-e«atic inquiry.- So far /as we. 
know, there' are no current studies of changes in the. types of individuals' 
entering academic careers today as compared with' earlier periods such as' 
the 1950's and 1960's. We know littl^'a^out the impact of the tightenijig 
job market upon the aspirations, work habits, productivity and effectiveness, 
of . both )«unger. aud older faculty -.e^s. We hear that faculty, are 
increasingly., alienated as a result '*bf lack of .mobility and lacK of 
public .suppor't -if or scholarly and e<^ucational activities, but we do not 
.know wha.t factors influence alienatloo versus coiailtment and productivity. 
What are the peer group. Influences, the communication channels, the 
competing interests that affect faculty enthusiasm and productivltyr 
Hop do faculty members* spend their, time and how is this irtf laenced by 
changes in governance, curriculum, or financing of, institutions? 

We also know little aboirt: the career development of faculty ddnbera. 
There are many tales .of acadeiilc jaenopausal periods, but no systematic, ^ 
-studies and few data 'relevant to policy decisloAS ahput encoOrageaent 9f 

early retirement versus a move upward of compulsory retirement »ge are avail 
. able. - Studies of the flow of faculty lit^o and through academic careers. 
• could benefit from current methodologies in economics and sociology.. The 
Ef fectiveness, of 'triinlng^f faculty, the impact of systems, of evaluation 
of faculty for tenure and promotion, the effectiveness of different reward 



patterns — ill of these are qu^tiOns of relevance to the life of academic 
instittitions. \,j(^urr'ently th^^ are a large number of faculty development 
programs witH" wide variations in approach; While Hier^ are several good 
descripti9^, the^^i^/no syscematic comparative data on their ef f ectiveness • 
It coll^ge^ and/uniVersit ies are truly comniunities of learners, we need to 
be cotV:ern^d AboxjJL the learning and development of faculty as well as students. 
Psygflologn^^l ^search is giving new recognition to ^the importance of modeling. 
Thus facility irierabers' modes of thinking, enthusiasm about their subject 



fiat ter^/anci/ manifestation of values are lively to be of educational importance. 
We aj^aadjr have some data confirming this, but we still need additional research 
on /^he /actors affecting the in/luence of the faculty member and upon the 
role /f training, reward structure, peer group supports, change of activity, 
fee/back from students, and other factors upon the career development of the 
Oyculty members. 

We knqw that intellectual functions continue to develbp as one ages, 
but we know little about the normal patterns of career development of faculty. 
!<; there an acadcmi'c menopause? Are there significant number of "deadwoods" 
and if so, can they be brought to life? Currently there are large numbers 
of pro^ram-i of faculty develqpment but , relatively little evaluation of 
ef fect^iveness. One would suspect that , a program designed to "retread deadwood" 
would haw care- difficulty than one that involved faculty in new programs 
using their strengths as a b^sis for developing new competencies. 'In any 
case» educational research in this area has relevance not only to faculty 
development but also to our more general interest in adult development and 
oHucation. 
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' ' ; Finally, tecg^^nize the impact of -Q-oMective bar^alnlng'*^ 

* faculty .Berrale. and 'faculty pmi^ip>tlon in instUiitional governance. 

Currently we have a greats ^atTy^studles -dealing with this topic in terms 

» ' ; * * ' - ' * 

* of itg. impac^upofr.4i^cision making ahd the distribution of power, but 
- relativeiy. few- in terms of its effect on teaching and learning and the 

relationships to faculty members and students. 

; 1 ^ 

The Curriculum 

^ i ' ' ^ - , 

Research on -post secondary curriculum 'is a largely undeveloped field. 

Changes in secondary school curricula have implications for post^ondary 

curriculum, Mo^^of the disciplines have committees studying cUtricula 

or developing new cUrricular approaches but little research has been done 

either upon the particirf^ aspects of curricular decisions within a given 

discipline or upon the broader questiofis of the effects of required vs- 

free elective systems, sequential vs. non- sequential arrangements of courses, 

pyramidal vs, hour-glass, v.s. linear patterns of coiWses, etc. Society 

needs individuals who can comprehend broad areaSrand who have the flexibility 

I.-, shift froh one set of problems to another. ¥et we dd.jiot know. whether 

\ ^ -/^ ' 

or not interdtsciplitjary progfamTariB realty better preparation -than 

- ^ ! * • • ' 

•disciplinary programs or even what factors in, disciplinary training affect 
rigidity or flexibility. Is r^liberal arts curriculum better preparation than 
a vocationally orierU^A-curriciUijm^ ' ^J^^^^^^^^ 

The Setting ' 4 

Concern ib^tit the evaluation of new irogtams and new colleges feads, 

.-^ - ' ' ^ 

directly into. the broader .question of the studies of- th6 acaHeaic setting 
g'^nerally and-it9 relationship to learning and teaching. Since the classic 
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. . stuites of th4 impact - of peer groups upon students carried. out by Newci)mb 
and Ithers. there.Ms beeq a hiatus in research on the broader questidns of 
studL development and learning in various types of settings. The" *apid I 
growtl of c<^unity.and junior colleges suggests the need for studies of ' 
non-residential learning experiences similar to those Newcgmb, Sanford, and 
others! have .made of residential four-year colleges. We know very little 
about iowcommuting students and part-time students iit education Into their 
' lives. What factors influence their learning and development, how tHe newer 
o{,en-unlversity types of experiences influence students, and how the process 
of education differs depending. «pon the setting in which it is carried out. 
For examlle; what is the value of foreign study or semester-abroad programs? 
Do they provide a different perspective than is not available locally^ What 
priority should they have in these tight fiscal times? 

\hus far we have said nothing about learning and teaching in graduate 
and professional education. Increasingly, there are educational units , 
concerned with improving .the effectiveness of leading and teaching in 
'professional schools. It seems likely that these units will provide a 
resource for developing research based policies relevant, t.o improving 
„ education outside the traditional liberal arts cujrriculvnn. More molar 
' studies of t.he role of graduate and professional schools with respect to, . 
social changes, such as change , in our health care or legal systems would 
also be useful. 

' ' IV. Outputs * ' ♦ 

! ■ ' ' ' ■ • ■ _ . 

Postsecondary education is currently under a great deal of pressure to 

justify public expenditures in view ot-^the- prresumed or actual declining 
« 
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economic value of education to the individual- This gives added motivation 
^'cr research concerned with developing better measures of non-monBtary 
benefits of education both to individuals and to society. Ultimately 
decisions about educational goals are value decisions^ but research can 
contribute in several ways, 

1, Those who establish educational values typically make 
assumptions about what alumni lack. Research can help in 
identify.ing what alumni of education feel they gained and 
would have liked to gain from higher education* Methods of 
analysis developed for assessing needs of special populations, 

t - such as the' handicapped or evaluating skill requirements 

for jobs 4n industi'y or the armed forces could be extended 
to analysis of the knowledge, skills, and attitudes 
* conducive to the general requirements of our society for 
its citirens. " ' 

2. Those* who establish educational goals also oftfnji^ke 
assumptions about a) relationships, between goals (compatibility 
or incompatibility) and the relationships between means and 
fends; b) aspirations and expectations of prospective students; 
c) consensus among the various groups interested in education. 
These two are researchable questions.' 

It is obvious that in most cases the true value of college education 
to an individual can be -determined only over the course, ot a lifetime. 
Nevertheless, we can certainly get some indicators of major educational 
outcomes. We can ispecify behaviors and attitudes that college educated 
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people should be. moVe; likely to possess. We are increasingly able to • < 

measure such aspects of cognitive flexibility, ability to see the complexity ' 

of problem situations, strategies for learning and solving problems, and 

ability to postpone closing ones' mind when the data are still out. Studies 

of abilities, values, and attitudes characterizing those who have been educated 

should be supplemented by studies of the lives of individuals, such as the 

longitudinal studies of the Project Talent sample, pr other intensive studies^ 

Df smaller numbers of individuals. It may be that one of the important 

outcomes of education is a meaningful integration of persc^nality. Typical 

cross-sectional studies of specific outcomes may miss unique interactions of 

educational experience, persons, and later environment. 

. There are now underway a number of major studies of spcial indicators 

and quality of life. Thus the evaluation of educational benefits and the 

development of educational indicators can be easily related to major 

developments in theory and methodology with broader social implications and 

.... - ^ • 

scier^tific interest. , ^ 

There lire some specific questions| with respect to the evaluation of 
outputs that have to* do with the manner in which assessment can be carried 
out. We need to study ways in which data can be gathered to influence public 
att-itudes toward the values of education and to provide useful feedback to 
institutions with respect, to evaluating their own programs and the effects 
of changes in_£rograms on educational outcomes^, -^ince many of the changes 
involve Idng term benefits, the problem of evaluation is much like that of 
studying genetics of , elephants , and we thus will need to develop 
J!»ethodologies that provide quicker feedbacVT on intermediate aspects of 
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education rather than relying completely upon the study of ultimate criteria 

of the achievement of educational goals, ,v ^ 

/ 

In addiction to the molar evaluation of the outcomes of education, 
ye obviously need further work upon, evaluation of outcomes of a mare immediate 
nature that can be useful to faculty members in developing curricula, and 
in improving their own teaching, and to adminls^trators and faculty members 
concerned about evaluating teaching for purposes of making decisions about 
promotion and salary increases, 

Still another categbry of evaluative information needed is that useful 
to students. We are lesa than adeqUamr-^qili£ped to give students information 
valuable to them not only in assessing .the progress they have made, but in 
providing evaluations that will enable students to develop the ability to set 
standards for themselves that they can use in evaluating their own learning 
and problem solving after they leave formal postsecondarV education^ 

Grading problems ^re currently^of a good deal of^publid interest, 
particularly in relation to the ^o called "gr^de inf•lation'^ While most 
of the attacks upon^the lack of correlati^^Tbetween grades and later success 
are probably not methodologically sound, research on the usefulness of grades 
and alternative methods af evaluating and predicting future achievement tould 
have considerable impact upon education^ ' \^ 

Current emphasis on competency based evaluation hoth with respect to 
* admissioA to postsecondary programs^ as well as to credentialing is of wide-, 
spread interest- NIE's current effort, in this dr^ seems to be a sound One 
and we recommend its pontinuation. ^ ^ - . 
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, V. The Institutions, the System, and Relationships to Society 

The previous chapters have dealt with the components of postsecondary 
education — t'he students, the process and the outcomes. There is little 
question as t<y the importance of research regarding these components, yet 
there ate other areas that also need attention. The settings in which students 
learn, teachers teach, are many and varied. They range"^rom fhe ti^aditional 
colleges and universities, to the community colleges, to vocational-technical 
institutes, to correspondence courses in the home, to store-front academies 
to non-traditional settings for use of /various types of media, _ ^ » 

Interfaces between Secondary and Posts^condary. Education »and Work ; . ^ 

One of the major areas of concern regarding the relationships of 
education to societjy begins with the interfaces between secondary' and post- 
secondary education and work.^ The secondary schools have long used an infor- 
nration system to direct select students into postsecondary education."^ A, • 
more comprehensive system is necessary so as to assure all secondary students - 
trhe opportunity to evaluate and choose what is best for them, be it more 
education or immediate entry info the labor force. A continuum for educati'onal 
counseling has to^^t>^a goal., , . , - - 

The^secondary school system has improved iti curricula and Unttbduced 
students to more sophisticated -material in earlier grades. Credit-by-eyaml^ation 
advanced placemepC, and ^^ven a flew coopepartive secondary/postsecondary 
arrangements have taken advanjcage of ''these, thus* shortening the time necessary 
to complete an educational ptogram^ Research is neeSed to ^etertaine'the best 
methods for achieving greater integration of both levels of education. 
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Just' as secondary and poslsecondary institutions have become clotfet, 
so have postsecondary institutions and the wOrld of work.: Cooperative 
education programs, apprenticeships, and other school/work relationships 
require research and evaluatian.. KIE is already doing good work in this area. 

^ C overn^nc e * ' ^ * , 

Tlie University exists as an organization and as a political milieu. 
The <HJrr?Pnt research on organi2iational behavior and d^ganizational development 
is relevant to college and university management, but relatively little 
research has been carried- out on colleges and universities themselves and 
their unique organizational. characteristics . 

The political forces outside and inside the institution contending ^ 
for power, the coalitions and copipromises engendered by the sometimes 
conflicting, sometit&es coinciding interests of those involved are appropriate 
"^xeas and potentially useful subjects for research. 

The roles of presidents, deans, department chairmen and other admin- 
istrators in determining educational effectiveness is little^derstood . The 
i..3ts and gains of extensive faculty and, student partici^tion ftKgovernance 
merits study. Of , particular interest today is tlj| iih^nglng power Structure 
as collective bargaining, state coordinating bodle^, and (for public institu- 
tions) increasingly active state budget officers constrain the freedom. of 
administrators and .faculty to determine institution^ policies. This general 
area is one in which methodology is gettiftg better art^'^ better and wh^re . 
political scientists, sociologist and psychologists^ Jali are working wtth 



■insufficient support. / - i >. 

■/ '4' 
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jfelvetslty of Stadents and Institutions 

^ The expansitjn.of postsecondary educational oppbrtuniti^s' In the last 
two decades has produced a wide assortment o( educatrlortal settings ,and oppor- 
tunities. Each institutign speaks of special missions .yf mrket groups, yet 
little serious work has been done regarding which institution ,i:an fuiail. 
which mission beU. ..Duplication of effort certainly occurs, and perhaps 
it should, b^ho is doing what for whom needs deflktn^n. The -aatlcipatetf 
drop in enrollfcfts. during the early 80' s has pushed educator? tp look for . 
new markets to fill the empty seats, ^ - . 

The nature of participation by adults and by others in postsecondai:ir 
education programs needs to^Ve investigated, with special attention given 
^o the effects of this participation' on the financing and management of the 
i^istitution. The adult Student is olten characterized as one whp participates 
on a part-time, drop-in - drop-out basis. • The. wide ^'oirBat of educational 
«odes combined with varying student mixes makes it essential thkt procedures 
for obtaining real cos\s-be developed. It then becoines necessary to determine 
who shduld pay these cqst* and the^value that the society receives fcom tV 
experiences. Providing adult literacy education can understandably be ' 
accepted as a function that society should pay for. \ut whatj^bsidy should 
sbciety'pay for training in macrami or cojltrdct bridge? ^ . ■ , 

1 Postsecondary education' has always been accAaimed for its diversity. ..- 
In addition to the definition of missions ^liggested abwe. there is .a re^l • 
need to examine the concept of divei^sity. Private education is often 
4ef ended as the alternative t» public education, yit little has been. ^ 
documented abdut wl^at contributions .private^e^ucational instllutdons. prpyide, 
to society. To, what degree, do different' iiSfttitutipns serM different 
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populations, achieve diffeting outcomes, attract differing sources of support? 



/ 



Institutional Size and I^catioiv 

In Addition to defining the^scope, missidv and value of post secondary 
education and the Institutions that deliver it, there is a need to do research 
on how best to optlij^ze each approach and type. We know very Uttie about 
the optiradl size of Institutions- Are there economics of scale? Can certain 
things be done at one size that can't be accomplishe4 at another? 'What i-s 
the Impact of size on student and faculty expenditures of time?^ What is 
the effect of geographical "distribution and density af institutions? Do' 
consortia provide opportun^^et and experience^ that are cost effective . v 
and beojBficial that w^wUd otherwis^ pot be proyided? 



'%The Value^crf Po^ secondary Education to Society - - / 

\ On tjhisi same theme there is a meed to look at postsecondayy education 

and its rdfctionship' to society as a whole. In addition' to studies of the 

' ■» + ' 

values of education in economic and fton-economic terms for the individual ^ 

recommended earlier^ it. li* also necessary- to ^look at the greater question, 

» - ft 

what value ts education to society?^ Institutions of t>ostSecon4ary education 
play a major role in the geographic community 'in which they are located. 
They may be a center pf culture; they may provide eScpertise for management 
in the cptomunicy;. they may be art economic resource. How can they work and 
relate to other commun^y itistitutions for the imptoycment of society? What 
v/ill chlinges in, or ^ven the demise of, 'son^. of these institutions -do, to 
,tl%e community, Nptate and nation? these relationships- and roles need to be 
conceptualized. This wholi area needs to be investigated not qnl^/from the. 
point of view of the econoiiiist bufe^.alsd* from tjie* areas-^pf conmuinicjlfions ' 



research, sociology, political Bcicnce, a5.throp«ilogy and social psyehotogy* 

* . . . /• - 

Flnnincln^ Po<;^_sccoh(lnry Educntlon ^ . • 

Practically (>vcry Foundation is involved id sapporting studies in 
.the^finanr.ng at postsccondar^^^^lucation. 'The- education associations are 

concerned. The policy analysts in^the .Government rank this as a primary 

» 

concern. . . ' *' 

NIF. will he holding a conference this summer to determine the national 

priority issues in fin,.nc.e and productivity. . The number of people and 
orraniaations workuip in this 'area is large, and therefore there is ,some 
question -as to what roUcNIE might appropriately, play. ^There is a high 
need for ^syivthesi s of irvformation, and for studies of practices that wark| 
and don't wo^k. fiffbnt might usefully be placed on the basJ« questions of 
the pc6per m\ of support And the advantages and disadvantages of o«e type ■. 
over another. The ccmnunity college reached a new area of finance for « 
postsecondary education by drawing' on the local .community tix-.base for 
support. Ia.th#ar^=a .they -hovr compete the^let^ent^ry-secondary School 

' system for support. '.What are theUg^ tatrg^ effects Q.f thi? competition? ' ^ 
With 90% of Eederal §uppprt fOr^postsecoftdary education being In. the form. of 
student assistanfev 'what;*are the-Wfects"on the varfbus. typ'es^of institutldtis 
While it is.'donceivlble .that .sti^fW aid "doirars ^r*serve .and Assist one type 
• of institution, do -thfey- b^ve ^e\Sarafe Wue. for" all?*~lIow do -^h^^^ affect . ; 

the edueiational opportunities for students not eligible- for .aid? How can 
' major .graduate r^eseardli _liistitutionS.be best supjported , to maintaiB-r—- 
" the 'intellectual- and research' cVpabillt-y, of the l&.tidn?.:.; - • ' 
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Institutional^ Evaluation ^ ^ . ^ 1 



Very little is known about the growth and dcve^lopm^t of educationai 

* institutions, particularly different types such as "tradition^ly black" 

f 

institutions, experimental colleges, etc* ^ Are" there certain nonnaX .patterns 
of- development? How do we evaluate institutional sucaess, quality and 
growth'' Research is needed in the area of institutional evaluation^ not 
from tlie point -of view of doing more evaluations but rather in developing 
nt methods of evaluation. This inf orma&ion'''woalxi'te v^l^alj.1^ to the 
accrediting process, the governance process, and planning and tundipg - 
efforts at the local, statue, and Federal level^ With the leveling of 
enrollments arid tight fiscal Ximes institJ^ions *re being tald to account 
for their actionsv^o be cost effective, and to be efficient. Boards of 




Control, government at all* levels, and the consumer may be asking the wrong 



questions and consequently .wrongsJctiohs^liay^ake place. As we indicated* 
•in the section on outcomes, better evaluative procedures and instruments 
may suggest new quest^ions and Setter answers, ' ^ 



?.)rtr ;ersh ips with O thers - , ^ ■ 

Many 6? the private foundations, thj^Jund for the Improvement of 
Postsecondary E^tmation^ and other agencies^a^^|||6iJ/?^mts and issued 
^ Contracts to individuals and institutions • in support of innovative procedures, 
proiocts ^n<i programs. * Evaluation of the results i% miniaal. There is - 
s need to ^co.p'rdinate innovation efforts across the country and provide 

feedback to Improve and verify the efforts in-place. Selective comparisons 

•if * 
« > * * 

sh:»uld be madd between alteftia^tive approaches to determine why one workd 

and another doel^n't. The. development of partnersjhips with foundations and* 

• »th€r 2(g^cies could be a significant development for NIE. Care Ahould be 

•* - ' * 
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taken In forming these papf Cnerships so as to avoid the impression- that the 
NIF is an audit agency oi*j|^t its efforts ar^ intended for \nse i«r><titical 



)i|||£t 
le^d 



ways, the results of theVpEdles should be useful to the Foanddf1*Qns and 
.Feiieral agencies. By conceptualizing major dimensions of innovations as 
NIE has dqne In open educati^^ evaluation of several programs *at dij^f^ing 

. ,.• . 'X ^/./'- 

points on the scale can produce conclusions of greater generality aifcjf* adaptive 
use than would evaluatipus ^f eaoit prdject as an entity. 

Data > ' ^ * ^ \ 

^'One of the /jost often heard criticisms has ieen about the type and 
quality of data available fc?r research, poiiicy stWlro^ pperatiooal 
analyses. Some of the data needs are sophisticated,' some basic-. Skza 
collecting and ^^^alysis agencies such as the National Center of Educational 
Statist ics accumulate ex'tenrsive <iata from the field. Axxalysis and verifl'-r 
cation of this data is oftentimes a lengthy procedure, and when it finally 
becomes available its value may be reduced because of its age. Much of 
the data collected ^is needed for single use or short-time needs assessment. 
Surveys, for certain d^ta are run on an annual ^asis and analyses detaonstrate 
trends and comparative conditions across time. ^One' of the more important 
survey types is the longitudinal survey. Longitudinal surveys are extremely 
important in— cney- trace a sample acress timfe» Unfortunately, funding 
ia the out year's is a major problem^ 

It does not seen^ to us that NIE should become another major data 
colletttlon ageacy. The Institute should, hoyfever, take a strong leadership , 
role in iden^fying and recommencing data needs, in setting priorities for 
collection and .in encouraging other prlN^ate ^nd Federal amentias to tDainta^n 



those data bases including longitudinal, necessary fdr many kinds of 
edac^tionai research. Research i< also needed on better instruments and 
methodology- . 

' * . y . . • 

*' * 

, , , « "* 

' VI. Summary and Reconmendatiens 

In the preceding sections we have reviewed various areas of researc 
suggested to us by those with whom we have talked. In this section we hop 
to describe certafn areas wfe' feel are of higHest priority and to disctiss 
briefly mechanisms of impltraenting and following up our work in NIE. We 
•l<5o will bring in some broader considerations of NIE strategies and 

mechanisms*. , , - * 

' ' » ' - " 

'""^^-W>oh»%*in| areas oOi^ priority we have given w^ightT to the 

following considerations: ^^^--^ ' " ' ^ 

1. The impartatjce-trf^the problem area lor decisions aff 

^--'the education of Students, Here we ar^ concerned not only 
about the importance. of .tbe decisions involved but also the, 
■ ■ links of a problem area with other subsidiary or related 
problems .and the degree to which^formation witli jrespect 
to tilts problem' area would haVe -usefulness in- -these related 
areas. t 

2. ^The relationship" for the problem area to btoader thearies or 

conceptualizations going beyond education. For- example, we 
were influenced by the relationship of areas to '^ew deveiop- 
mentd .in cognitive psychology, economtc models, or socio- 
logical theory.. ^ ^ , - • 

3. The availability of methodological tools. Here vre vete 



influ^ced by such things as the development of methodology 
having to do with quality of life and social indicators as ^ 
'•well as methodological developments in econometrics and 
other areas. 

.4. The relationship of the area to pifesent NIE strengths. We 
see NIE as paving a pool of high level talent. We tried to 
think about how our prpblem areas might fit with the current 
pro;:i ins and human strengths -of the NIE organization. Much 
of what ve suggest is already going on in NIE. 

High Priority Areas - ^ . , ' 

We have chosen seVen areas as candidates for "^tlie liigliest priority. 
For us this has b^n a difficult choice because each of the areas mentioned 
in the earlier ^ectide^s has appealing charq^cter^stics in terms 'of our curiosity 
about the answers and in terms of potential' impact upon education'/ -Hfev^r 
theless, we understand that our task is to at least provide a -beginning point 
for discussions for setting priorities in post secondary education and thus 
suggest the followinc^: , . . ... * 

1. Learning and cognitTon • ^ , 

2, Motivation and values 

, 3. Teaching — delivery systems 

4. Evaluation of Outcomes — Assessing the value of postsecondary 
^ education 

5. Governance and management 

6. Costs and finance of postsecondary educatio^n 



7. Interfaces between secondary and postseconda[ty education, 
and work. 



The.matrix-beiow gives our ^impressions of where each of these 4:he3.?s 
fits vifwr the" pre'seTt rr^^t^^ Obviously, the,NIE staff knows'better 
than we where* relevant work is, or should, go on. In any case, we breneve_ 
that it is likely that the post secondary areaHs one requiring cooperation 
across Groups. ^ . 



Hi^h Priority 
Areas 



Learning and 
Cognition 



Mbt<i>^Ci<>fv and ..^ j 
Values t 



Teach 



ivery i 



Basic 
Skills 



Education 
and Work 



Education- 
Equity 



Finance and 
Productivity 



Evaluation of 
^ Cu^ comes 



-T: 



Governance and 
^ Nno^gement 



Co-^^iV and -Finance 



Interfaces between 
secoudary/^ftfrt 




jt ^ 



Capacity 

Problem 

Solving 



* X 



X 



' From this acc^ufttT-iiJa^P^s^that^ w6 have neglected the Disseni.na'tion 
and Resources Groip. Obviously^. disseiinatiJirir"ir^fflportflfjvt 
education asyin the^dther levels of jeducation. We believe there is ^special 
need for work sumBtorizing the State, of research in a number of areas. Some 



*of the Foumiat ions?,* for example, have suggested that it^ would be useful 
* * > - 

to them to have a summary of research indicating areas ripe for application. 

They see NIE aa providing a possible basis for their decisions about areas 

In'which support woi^ld likely to 'be productive. The present pubiications of 

EK I probably meet some* of these needs, but it may be that there is a need 

for tbe capability or putting together such summaries with respect to 

partldilar 'areas with a shorter turn-around time. 

' •Some of our consultants have despaired of reaching the faculty. 

Admittedly, reaching faculty is difficult, but there are a number o'f hopeful 

aspects of the pi^s»ftt 'situation. One af these is the rapid growth of 

faculty development centers in most colleges and universities. Wtfile such 

centers still have much to do they are reaching large numbers of faculty and 

-provide an important new channel for dissemination. A second factor is the 
"in reaseii interest of the scholarly associations in teaching ^and undergraduate 
education. New divisions are being forflied^ new journals are being started. 

^^^^S"?. ^•the* disciplines provide another cotamanic^ion channel and support ' system. 

^ ■ ''''' * ; ' , r k , 

Finally, the increased emphasis, upon teacljiing and undergraduate education In 
'{>romotion and salary judgments is changing the reward structures to encourage, 
better utilization of research on learning and teaching. 

^ Linking NIE Groups ' ^ • 

One of our hopes in recommending the priority areas al)ove i^ that 
they will be^ •mutually suppbrtive. Obviously, research in learning and 
i&otivktion has. imp^lications for tfeaphing, but it ma/ not be. so obvious 
that it has great relevance for work in veasuring outcomes and for research 
on the interface of education and work. Similarly, the refsearch on governance 



has links with finance, with teaching, and with the area of motivation and 
values. Studies of costs and finance link with the interface and governance 
questions but also have relevance for motivation and teaching. 

We believe that by facilitating communication and joint supijort of 
programs the total impact of the NIE program Can be greater than the 
sum of its parts. 

Mechanisms 

The previous section has identified seven major areas for NIE emphasis 
in postsecondary education. The report has identified other areas of concern 
that we have reluctantly put_in a lower priority. In the development of this ^ 
report, it has become clear that there are various ways in which NIE could 
become involved in a given area. In some cases interest demonstrated by a 
low cost investment and presence would be Sufficient, whereas in others a 
major scale /of effort, both in-house and externally , might be appropriate. 

We have some feelings about mechanisms but offer them only as starting 
points for ^aff discussion. - - 

• ^ ' - ^ ^ 

1, Learning and Cognition 

* t 

This is the one area in which we recommend support of basic research 
Despite the great research progress of the past decade, funding has dropped 
drastically* At this time the link between basic research on cognition and 
research on educational learning is tight and research support for both is 
likely to be productive. This sort of research seems generally to prosper 
from funding through unsolicited proposals. 

2. Motivation and values \ \ . j 

M , , ♦ - 

• ... * 

In this, genei^al area we see as a first step» grant support of 
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research on factors affecting motivation for continued learning and research 
on educational influences on value .integration and behavior. This too is an 
area in which the grant mechanism seems appropriate. 

3. Teaching — delivery systems 

In this area we see two areas of high priority — the study of ^ 
effective teaching at the level of the individual class or course and the 
broader, studies of major aspects pf delivery systems, such as open learning. 
Progression the former , can -be made through grant support, the latter seems 
more appropriate for a contract. 

4. Evaluation of outcomes 

One likely opportunity for progress is to link NIE!s effort to 
that of some of the organizations now doing research on- social indicators 
a; J quality of life. / ^ 

5. Governance and manajgement 

Methodology in this area is improving; yet support for research 
has been declining^ Grant support here should be productive, 

6. Cos^ts ^nd' finance . " 

This is an area in which a number o£ agencies and organizations 
are doing research and policy analyses." Thus we do not see a need for a 
major additional effort by NIE, but believe synthesis of information through 
conferences or summary reports would be useful^ Following such a synthesis 
filE might wish to implement a program of grants in response to uttsolicited 
proposals. - < ** " ' . 

?• Interfaces between seco'ndaiyr^ and postsecondary education aftid wotk 

In this area NIE already has a number of activities underway. They 
appear to- us well conceived and we trust that support can be continued and 
str ythened. ' • * ^ • , 
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Because we believe e 




uld be given to developing the national 



. research capability, we have suggested \increased use of the competitive ^rant. 
process rather than-large demonstration projects or ma;jor center* support. ^ 
Consideration should be given to ways of fostering assemblages of investigators. 
At those places where a^ critical mass of researchers exists, some provision 
for a "cushion" between funding. cycles chouls be provided. 

There is also a need for the definition of problems and the ^development 
of ideas. An investigator needo a small amount of support to develop ^he 
analysis of what should be investigated. Support of this type of activity 
is hard to find. It wo\jld seem appropriate that th^^issemination and Resources 
group develop an open-ended, quick turn-around, small grant program for 
projects designed to answer ^^^^diately relevant questions or to help in 
defining problems that research can answer. • 

Central to the themef of NIE and recommendatiqns made in this report 
i3 the necessity to bring the best minds available to work together on the 
problems of postsecondary education. |lesearch on postsecondary education 
belongs^o ho one discipline and NIE should take ^s one goal that of increasing 
the numj)er of to]p f ] ight researchers who a^e*" tarrying out research^- in pbst- ^ 
secondary education. Presently this area is not^prestigeful in any of the 
relevant disciplines. We believe ^lE can attract the best scholars.. Appoint- 



ments in NIE as well as the development of an ii^house internships program 
ai\d support for doctoral and postdoctoral siudia«-ean supplement the progtam 
df reslBarch support in increa-sing the pool* of'^.aleRt..contribution to our field. 
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